Phase Diagram of the Spin-Orbital model on the Square Lattice 
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We study the phase diagram of the spin-orbital model in both the weak and strong limits of 
the quartic spin-orbital exchange interaction. This allows us to study quantum phase transitions in 
the model and to approach from both sides the most interesting intermediate-coupling regime and 
in particular the SL r (4)-symmetric point of the Hamiltonian. It was suggested earlier by Li et al 
[Phys. Rev. Lett. 81, 3527 (1999)] that at this point the ground state of the system is a plaquette 
spin-orbital liquid. We argue that the state is more complex. There is plaquette order, but it is 
anisotropic: bonds in one direction are stronger than those in the perpendicular direction. This 
order is somewhat similar to that found recently in the frustrated J 1 — J2 Heisenberg spin model. 



I. INTRODUCTION 



> 

qq ■ In many transition metal oxides the low-lying electron states are characterized by both spin and orbital degrees 
' of freedom. Thus the simplest model that also takes into account the strong Coulomb repulsion of transition metal 
t-H , d- electrons is the multiband Hubbard model. For the case of one electron cer site with two-fold orbital degeneracy 
(isospin T — 1/2) and the strong interaction limit Kugel and KhomskiiEl derived the effective spin and isospin 
Hamiltonian: 



H = ]T ( J S ; • Sj + J T, • Tj + V (Si • Sj)(T, • Tj) ) . (1) 

<U> 

Here Si and T| are spin and isospin operators at the lattice site i, and the summation is over the nearest neighbor 
. bonds (i, j). J and V are positive constants of approximately equal magnitude. 

In general, the exchange constants in spin and isospin subsystems may differ. It is also possible that the isospin 
interaction (TiTj) is not spherically symmetric. If the isospin interaction is spherically symmetric then the total 
O ■ symmetry of the Hamiltonian (|l|) is SU(2) x SU(2). At the point J = V/4 the .Hamiltonian has even higher SU(4) 
\ symmetry. Investigation of the model at this point has attracted great interesinO. In the one-dimensional case there 
KJi ' ^ s an exac t solution for the ground state and for several types of excitationsoQ. For the two-dimensional case (square 
lattice.) an exact solution is not known. A kind of HWan field S'(7(4)-spin-wave theory has been developed for this 



caseEffl, and numerical simulations are also available&EI. The 5?7(4)-spin-wave theory indicates a disordered ground 
state at J = V/4. However this approach contains uncontrolled approximation, and its accuracy is uncertain. It was 
pointed out in Ref.@ that at J = V/4 the Ising part of the Hamiltonian (]l|) is equivalent to the 4-state Potts modelEj. 
This model has classical macroscopic degeneracy of the ground state, and this is another indication in favor of t 
disordered ground state of the spin-orbital model at the SU(4) point. As a possible ground state the authors of Ref. 
suggested a liquid of plaquette SU(4) singlets. This ground state is a SU(4) singlet, but it has spontaneous breaking 
of the translational lattice symmetry. Further analytical and numerical work supports this scenaricLTu. 

The present work has the following goals: to investigate the spin-orbital model on the square lattice, away from the 
J = V/4 point and to identify all the quantum transitions, and also to investigate the model away from the isotropic 
SU(2) x SU(2) line. We also present new evidence in favor of the anisotropic plaquette spin-orbital liquid in the 
vicinity of the SU(4) point. The structure of the paper is as follows. In Sec. II we start from the limit J 3> V/4 and 
then approach smaller values of J, using both spin-wave and perturbation methods. In section III we consider the 
opposite limit, of strong quartic interaction: J < V/4. In this case the spin-wave theory is not valid and the only tool 
is a modified series expansion. Our conclusions are presented in Sec. IV. 
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II. THE CASE OF WEAK QUARTIC INTERACTION, V/4 < J 



In the limit J ^> V the Hamiltonian (|l|) describes two almost independent Heisenberg subsystems. Both of them 
are ordered antiferromagnetically, and so the SU(2) x SU(2) symmetry is spontaneously broken. Therefore there are 
two Goldstone excitations, spin- wave (s- wave) and isospin-wave (t- wave), that determine the low energy physics of 
the model. The ground state is a direct product of the Neel-ordered spin subsystem and of the Neel-ordered isospin 
subsystem, with two sublattiees in each subsystem. In each sublattice we introduce a Dyson - Maleev transformation 
of spin and isospin operatorstil. For the A sublattice, 



Sf = S - ajo, , T? = T - 4c 5 , 

,t rp— _ J 



Sr = a] , Tf = c\ , (2) 

St = (2S - afa, )o, , T+ = (2T - c}q )c. . 



and for the B sublattice, 



S^-S + bfo, Tf = -T + d\d, 



Sr = -b. , Tf = -d. , (3) 

5+ = -6j(25-6t6.), T+ = -d](2T - d^) . 

We are interested in S = T = 1/2, but for now we keep them as parameters. After the transformation the Hamiltonian 
(|l|) takes the following form 

H = -~(J - VT 2 )S 2 zN + (J- VT 2 ) J2 (Siata, + bfo - a.b. - a\b\) + l -a\(b\ - a.fb^j (4) 



\{J-VS 2 )T 2 zN+{J-VS 2 )Y, (n4c i +4d i -c i d i -cidl) + U(dl-c i ) 2 d. 



(J - VS 2 )T 2 7.N 4- (J - VS 2 ) 

(iJ) 

Here N is the number of lattice sites and z = 4 is the number of nearest neighbors. In eq. (Q) the part containing 
only the operators a and b describes the spin subsystem with a renormalized exchange constant, J — > J — VT 2 , 
while the part containing only the c and d operators describes the isospin subsystem with similar renormalization, 
J — > J — V5 2 . The other terms describe the interaction between the subsystems. 

In thej-Jjnear spin wave approximation we neglect all quartic terms in the Hamiltonian (|J). After this the 
standardly Bogoliubov transformation diagonalization gives the dispersion relation for s- and i-waves: w s (k) = 
(J - VT 2 )Szy/l -7 2 (k), w t (k) = (J- VS 2 )Tzy/l -7 2 (k), where 7 (k) = ^(cosfc^ + cosfey). The staggered magne- 
tization in this approximation is independent of J/V, and is 

(S z ) = S - 0.1966, (5) 
(T z ) = T- 0.1966. 

One can also easily take into account single loop corrections to the linear spin wave approximation. To do this, 
following the usual procedureO, we make all possible decouplings in the quartic terms in the Hamiltonian (^). This 
gives the following effective Hamiltonian 

H = ~\{J- VT 2 )(S 2 - k 2 )zN - -(J - VS 2 ){T 2 - n 2 )zN - ^V{S 2 T 2 + 4k 2 )zN (6) 

+ j s sj2(4 a i + b l b i - a i b j- 4 b }) + ^ T XM c i + 4 d j ~ c i d j- 44^ ■ 

(i-j> (i-j) 

(7) 

Here we use the notations: 
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J s = (J - VT 2 )(l - k) + 2VT 2 n, 

J t = {J -VS 2 ){1- k) + 2VS 2 k, (8) 
«=~(<ak>- Mj>) = i (&&,>-<«$>) = i(<ck)-( Ci ^j>) = ^(<4^J>-<44>)- 

The value of k can be calculated in the linear spin-wave approximation or it can be found self-consistcntly. Both 
values are very close. For further analysis we take the self-consistent value: K = — 0. 07897/5. The excitation spectra 
for s- and t- waves are then 



w,(k) = J s 5zv/l- 7 2 (k), (9) 
w*(k) = J t Tz v/l- 7 2 (k). 

The difference from the linear spin-wave approximation is only in the renormalized values of J. The staggered 
magnetization is exactly the same as that in the linear spin wave approximation, see eq. (J^j. The values of the 
effective exchange constants J s and J* vanish at some critical value of the bare exchange constant J. One finds from 
eqs. (ph that at S = T = 1/2 the critical value is 

J c = VS 2 ^—^ = 0.3182V. (10) 

S — K 

The staggered magnetization given by eqs. (^) remains constant on approaching this point, and therefore the quantum 
phase transition at J/V ~ 0.32 is of first-order. 

In the above analysis we have taken into account explicitly only the s- and i-waves. However along with these two 
excitations there are also the so called spin-isospin excitations (st-wave) carrying simultaneous spin and isospin flips. 
In the spin- wave approach the si-excitations are not treated explicitly. They appear in the calculation via the quartic 
interaction term in the Hamiltonian (Q) that we treat in the one-loop approximation. However as one approaches 
the transition point this interaction becomes more important and our way of treating it is questionable. Moreover, 
it is known that, in the ID model at J = V/A for S = T = 1/2 the s- t- and si-excitations are almost degenerate at 
k — > 0, see Ref.u. This raises further questions about the validity of our implicit treatment of the st-excitation. In 
the remainder of this Section we treat the st excitations explicitly. 

The spin-wave approach is not convenient for the explicit consideration of the st-excitation. To address this 
problem we use a kind of series expansion method. One takes the Ising part of the Hamiltonian ([!]) as a zeroth-order 
approximation and the transverse terms are treated as perturbations proportional to the introduced small parameters 
x and y. So we represent the Hamiltonian (Q) in the following form 

H = H + H s + H t + H st , (11) 

H ° = ( JS i S i + JT * T i + VS i S i T i T i ) > 

<iJ> 

H s = \ ]T(J + VT?T?){StSr + S^Sf) , 
(U) 

H * = f E( J + VS?S?)(T+Tr + T.-T+) , 

(iJ> 

H °* = T V + SrS+)(T+Tr + TrT+) . 

(iJ> 

The properties of the initial spherically symmetric Hamiltonian (|l|) are recovered in the limit x = y — ► 1. 

The effect of the H s perturbation (y = 0) alone leads to the the same reduction of the staggered magnetization as 
in the pure Heisenberg model. The average spin is reduced from 1/2 to 

(Sf) = 1/2 - x 2 /9 - x A A/22b - ... -> 0.307. (12) 

The numerical value corresponds to x = 1, see RefH The antiferomagnetically ordered isospin subsystem background 
results only in a renormalization of exchange constant J — > J — V/4. However it does not effect the magnetization as 
it does not depend on J. The same effect occurs with H t acting alone on the isospin subsystem. 

An additional reduction of the staggered magnetization appears due to the simultaneous action of H s and H t (s + t 
channel). For example first H s flips the spins at nearest sites and then H t flips the isospins at the same sites. So a 
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virtual fluctuation with si-flips at neighboring sites is created. After that the fluctuation can collapse back to the Ising 
ground state using the same chain of spin and isospin flips. Thus the effect of the staggered magnetization reduction 
arises in 4th order of perturbation theory and hence it is proportional to ~ ( J — U/4) 4 /J 4 . Near the critical value 
J S3 J c ss 0.32V, this reduction is so small that there is no point to calculate it more accurately. A more important 
effect arises from the H st term (si-channel) in the Hamiltonian (|TT|). This perturbation creates, in first order, a pair 
of si-flips at the neighboring sites. The matrix element of the perturbation is xyV/4, and the energy of the virtual 
excitation is AE = 6 J. Hence the reduction of the staggered magnetization due to this mechanism is 



' " (13) 



At the critical value J sw J c « 0.32V and at x = y = 1 this gives S(S Z ) « —0.07. This is the additional reduction 



of the value presented in eq. (12). We see that the effect of si-excitations is not completely negligible, but it is not 
qualitatively important: the staggered magnetization remains finite at the critical point. This supports our conclusion 
that the phase transition from the NeelxNeel state at J > J c « 0.32V to some other state at J < J c is of first order. 
Unfortunately because of the first-order phase transition this analysis does not give any insight into the structure of 
the ground state at J < J c . A different approach is needed for consideration of the strong quartic interaction limit. 



III. THE STRONG QUARTIC INTERACTION CASE, < J < U/4 

We will see that in the limit J < U/4 the si-excitations are crucially important. This makes this regime qualitatively 
different from that considered in the previous section, and this is why the spin-wave approach is not helpful at J < U/4. 
We base our analysis on series expansions using a representation of the Hamiltonian (Q) in the form (11). There are 



two immediately obvious possibilities for the ground state of the system at small J: a) The Neelx Ferromagnetic state 
(NxF), where one subsystem has Neel ordering and the other is ordered ferromagnetically, b) The Stripe x Stripe 
state (SxS), where one subsystem has collinear magnetic order along one crystal axis and the other subsystem has 
collincar magnetic order in the perpendicular direction, see Fig.l. The NxF ground state spontaneously violates the 
SU(2) x SU(2) symmetry of the Hamiltonian ([[]). The SxS state in addition violates the C± v group of the square 
lattice, so the total spontaneously broken symmetry in this case is SU{2) x SU(2) x C^ v . 



Now let us look at the Hamiltonian (11). One can easily show that in the Ising limit (i.e. at x = y = 0) the 
NxF and SxS states have the same energy. Moreover there is an infinite set of other degenerate states because a 
simultaneous spin-isospin flip on any lattice site (si- wave) does not cost any energy (we consider the S = T = 1/2 
case). So in the Ising approximation there is an infinite macroscopic degeneracy of the ground state. What we want 
to demonstrate first is that the quantum fluctuations stabilize the SxS state. 

Let us consider the simpleast quantum fluctuations: spin or isospin flips at nearest sites, s- and i-waves. These 
fluctuations are generated by H s and H t correspondingly, see eq. (|llj). A straightforward second-order perturbation 
theory calculation gives 

B».—k + & + f< {v+4j) 




4(3U - 4J) 

Thus the SxS state has lower energy than the NxF state for x — y. So, in the following, we consider only the SxS 



state. However eq. (14) does not answer the question posed above: what is the excitation energy of the si- wave above 
the SxS background? If it is still zero then the background is unstable. Analysis of the second-order perturbation 
theory result shows that the si-excitation blocks some s- and t- fluctuations, and hence the si-excitation energy is 
nonzero. A calculation gives the following value of the si-gap 

A st = E st - E SxS = 2(x 2 + y 2 )( J+ — ( — V (15) 

bxb v ~ry jy -r 4 y ^ 3 y_ 4 j y 3U — 8 J/ v ' 

where E st is the energy of the S x ^-background with one si-excitation. In this order of perturbation theory the 
si-excitation is dispersionless. The gap A st vanishes at J = and J = U/4. However the gap is positive in the 
interval < J < U/4 and hence the quantum fluctuations do, in fact, stabilize the S x 5-state. 

One can also calculate the dispersion relations of s- and i-waves. To first-order in H s and H t the results are 
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w 8 (k) = V/2 - x{V/4 - J) cos(fc x a) , (16) 
Lo t (k) = V/2 - y( V/4 - J) cos(fc a a) . (17) 

We see that these energies are substantially higher than A st . Therefore below we concentrate on the si- waves that 
drive all the critical dynamics in the system. 

The excitation energy of two remote st- waves is 2 A st . However if two st- waves are localized at the nearest diagonal 
sites of the lattice then supression of quantum fluctuations is reduced and a direct calculation shows that the energy 
of such a configuration is just A S {. This means that two st- waves attract each other and the binding energy is 
£6 = 2 A s t — A s < = A st . We would like to stress that this is not an effect of a simple potential attraction, this is the 
effect of a quantum bag: supression of quantum fluctuations. 

We have found that there is a quantum bag attraction between the si-waves. In this situation it is quite natural 
to put more si-waves in the bag. Three excitations do not fit naturally into the square lattice, and therefore we 
consider four si-excitations combined into a plaquette bag as shown in Fig. 2. This is the plaquette excitation. The 
corresponding excitation energy, the plaquette gap Ap , is equal to 

V\ 2 ( 7 4 1 



Ap = 2(x 2 +y 2 ) J+- : . (18) 

v J ; \ A) V3V-4J 3V 3V + 4J 3V-8J/ K ' 

The value of Ap versus 4 J/V is plotted in Fig. 3, as the solid line. For comparison in the same Figure we plot the value 
of A st given by eq. dl5|). The gap Ap vanishes at J = 0.239V and in the interval 0.239V < J < 0.25V it is negative. 
This means that in this interval the S x 5-state is unstable with respect to condensation of plaquette excitations. In 
the phase diagram shown in Fig. 4 this region is separated from that with smaller values of J by the vertical dashed 
line J f» 0.24V. Naively one would say that a crossing of this line corresnends to a second-order phase transition from 
the S x S-state to a state with the plaquette order considered in Refs.Bfl. However, one needs to examine this more 
carefully. As we mentioned above, the S x S'-state violates the S , J7(2) r x_.5'[/(2) x C^ v symmetry of the Hamiltonian. 
On the other hand the plaquette state at J = V/4 considered in Refs.Em violates only Zi x ^-symmetry (plaquette 
state has 2-fold degeneracy in ^-direction and 2-fold degeneracy in ^-direction) . As we have demonstrated above, the 
Z2 x Z2 order parameter appears in the second order phase transition at J ss 0.24V. However the question arises: 
how do the *i|-[(2) x SU(2) and C^ v order parameters disappear when going from small J to J = V/4. To confirm 
this scenariotm we have to find two additional quantum phase transitions: 1) disappearence of SU(2) x SU{2) order 
parameters, 2) restoration of C± v order. 

The SU{2) x SU(2) order parameter is the usual staggered magnetization. So let us calculate reduction of the 
staggered magnetization. There are four types of relevant quantum fluctuations that reduce the magnetization A) 
spin flips at nearest sites, i.e. a virtual creation of two s-waves, B) isospin flips at nearest sites, i.e. a virtual creation 
of two i-waves, C) simultaneous spin and isospin flips at nearest sites, i.e. a virtual creation of two si-waves, D) 
similtaneous spin and isospin flips at four plaquette sites, i.e. a virtual creation of a plaquette excitation. We cannot 
use a conventional perturbation expansion approach because, in the Ising approximation, the excitation energies A st 
and Ap vanish, see eqs. (|f) and (|l|). Instead we use the Tamm-Dancoff methodll3 that accounts for all low energy 
physical excitations. The average value of S z is equal to 

1 r, ( \ , ( tst \ , ( tp N 



< s 'i=2-H£J -'{£;) ■ (19) 

Here A s = 3 V/4 — J and A st , Ap given by eqs. (plf) , (fi8|) are the excitation energies corresponding to the fluctuations 
A, C, and D. The matrix elements t s , t st , and tp are the amplitudes of creation of these fluctuations from the Ising 
ground state. The fluctuation B (isospin flips at nearest sites) does not contribute to the reduction of (S z ). The 
coefficients 2, 4, and 4 in eq. ( |l9| ) give the number of possibilities for a given virtual excitation to contribute to the 
reduction of (S z ). The amplitude t s arises in the first order of perturbation theory in H s , the amplitudes t sp and tp 
arise in the second order in H st or in the combined fourth order of H s and H t . Direct calculation give the following 
results 



(20) 
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Substitution of these amplitudes into eq. (|19|) allows us to find the reduction of the staggered magnetization. In the 
final analysis we set x = y. At any given value of J the magnetization vanishes at some particular x. This is the 
location of the second-order phase transition from the magnetically ordered phase to the spin-orbital liquid. In the 
phase diagram shown in Fig. 4 the solid line separates these two states. 

Thus we have found the transition from the magnetically ordered S x Estate to the spin-orbital liquid. However 
we do not see any mechanism for restoration of the C4„-symmetry violated in the S x S-state. These considerations 
lead us to the following phase diagram, see Fig. 4. The phase (I) below the solid line is the Stripe x Stripe phase 
which has a nonzero staggered magnetization and also spontaneously violates the C4„-symmetry of the Hamiltonian. 
The phase (II) is the spin-orbital liquid. It has no magnetization, but still must violate the C^-symmetry. So the 
symmetry of this state is exactly the same as the symBaefcey of the columnar dimer spin liquid in the frustrated J\ — J2 
Heisenberg model at 0.38 < J%/ J\ < 0.5 , see RefsJl3~llj Certainly we cannot claim that the state (II) is a kind of 
dimer quantum liquid, but its symmetry is the same. Finally, the state (III) on the right hand side of the dashed line 
is a plaquette spin-orbital liquid because of the condensation of the plaquette excitations at J w 0.24 V. However it is 
not an isotropic plaquette liquid considered in Refs.cffl. According to our symmetry considerations the C± v symmetry 
must be violated, so this is a plaquette liquid with bonds in one direction different from that in the perpendicular 
direction. One can say that it is a Stripe-Plaquette-Correlated quantum spin liquid. It violates the Z-i x Zi x C^ v 
symmetry of the Hamiltonian. i-T||hjs state is similar to that found recently in the frustrated J\ — J2 Heisenberg model 
at 0.5 < J2/J1 < 0.6, see RefsMlli 

Our analysis is based on the Tamm-Dancoff expansion at small x. One certainly cannot guarantee that there is not 
an additional phase transition line somewhere at x ~ 1. In our opinion such a qualitative difference is unlikely, but it 
is possible. This is why the problem certainly requires further numerical analysis. 



IV. CONCLUSIONS 



We have analyzed the properties of the spin-orbital model on the square lattice in the weak and strong coupling 
limits. We show that in the case of weak quartic interaction the usual spin-wave approach is valid. There are the 
st-quasiparticles that are not adequately described by this approach, but in this limit these quasiparticles just give 
small corrections. In the strong quartic interaction limit the spin-wave approach can not be applied because all the 
critical dynamics is driven by the composite st-quasiparticles. The usual series expansion method also cannot be 
applied because of the infinite classical degeneracy. To analyze the situation we apply the Tamm-Dancoff method 
that proved to be efficient in this limit. 

At J/V > 0.32 the ground state of the model is a direct product of the Neel ordered spin subsystem and the Neel 
ordered isospin subsystem. There is a first order phase transition to the spin-orbital quantum liquid at the point 
J/V ~ 0.32. We argue that this quantum liquid also has a structure. At < J/V < (J/V) c it is a stripe liquid 
with spontaneously violated C^-symmetry. At the critical point (J/V) c there is a second-order phase transition 
to the stripe-plaquette-correlated liquid that spontaneously breaks Z2 x Z2 x C± v symmetry. The Tamm-Dancoff 
method gives the following estimate for the critical point: (J/V) c ~ 0.24. Thus we argue that the stripe-plaquette- 
correlated quantum spin-orbital liquid exists in a narrow interval 0.24 < J/V < 0.32 around the SU(4) symmetric 
point J/V — 0.25. The structure of this state is more complex than has been believed previously: it violates an 
additional C^-symmetry of the Hamiltonian. 
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FIG. 1. The structure of the Stripe x Stripe state. 
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FIG. 2. Plaquette fluctuation in S x S background 
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FIG. 3. The plaquette energy gap Ap is shown by solid 
line. The energy gap A st of the state with one st-Rip is shown 
by the dashed line. 
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FIG. 4. Phase diagram x — J/V of the spin-orbital model 
on the square lattice. (I) is the Stripe x Stripe phase with 
non-zero average spin and isospin; (II) spin-orbital liquid; 
(III) plaquette spin-orbital liquid; (IV) NeelxNeel state. 
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